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ABSTRACT 

A criterion-referenced instrument. Inventory of 
Cognitive Skills and Visual-Motor Functioning, was devised to 
evaluate a prekindergarten program for economically disadvantaged 
4-year-olds. The Inventory^ administered to each child at the 
beginning and end of the preschool experience, provided specific 
information in: (1) knowledge of body parts, colors, shapes, and 
numbers; (2) information from pictures; (3) story comprehension; (4) 
picture comprehension; (5) concept knowledge; [6) following 
directions consisting of multiple parts; (7) copying shapes; (8) 
gross motor coordination; and (9) rating of responses during 
assessment. The assessment resulted in more precise classroom 
planning and batter knowledge of the developmental level of the age 
group. An important part of criterion-referenced assessment is task 
analysis, or breaking down skills into their component parts* The 
Boehm Test of Basic Concepts illustrates the task analysis approach. 
Fifty concepts are tested to determine which present difficulty for 
individual pupils. With the test, teachers or specialists can 
identify individual strengths and limitations and group patterns, all 
of which can be used in classroom planning. Instructional procedures 
need to carry the task analysis further by tapping the many levels of 
concept learning and application, from concrete to abstract. (KM) 
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ASSESSING FOR TEACHING WITH YOUNG 
CHILDREN 



As a psychologist working with a prekindergarten progi^am you ha-re been 
challenged with the problem of evaluating program effectiveness. You have to 
make the decision whether to follow the traditional route and carry out your 
evaluation by administering available standardized tests prior to and following 
the children's year in prekindergarten. From the improvement in test scores 

you would determine program effectiveness. Or. you might decide to take an 

't 

alternate route and devise assessment materials tied to clast^rocm goals. By 
generating specific inforraation about each child *s functioning, related to his 
or her school program, you would assist the teacher in curricular planning. This 
' was the decision that recently challenged the writer and will now be discussed. 

When charged with the task of evaluating whether or not a prekindgergarten 
program "worked", the writer made the decision not to use existing standardized 
^ tests as the general model for e'^uluation. Your immediate question might be, 

< WHY NOT? 

"•^^'^ The prekindergarten program with which the writer was involved was geared 

to econcxnically disadvantaged k year old children and was one of a nmber of 

tr - ' 

r such programs funded by New York State. One hundred and fifty children were 

enrolled in this particular program in 10 classes of 15 children each. Each 
class met for a half-day and was staffed by a teacher and a teacher aide. 

Since we were charged with admitting the most needy children and since 
no follow- through program was then in action, the writer and staff worked 
together in formulating the role for assessment, determining that it: 
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(1) must be tied to program goals, 

(2) provide the teacher with useful information 
for program planning, and 

(3) must not slot children with a general score that 
could be subject to misinterpretation at a later 
date. 

Discussions with staff; reading of available evaluation materials, stated curricular 
goals and gxxidelines; observation within the classrooms; and, consideration of 
kindergarten activity, all resulted in the develojanent of an instrument entitled 
"Che Inventory of Cognitive Skills and Visual>Motor Functionin g*^ which is available 
from the author. 

T-iis Irventory, individually administered by the teacher and/or aide to 

each child at the beginning and end of his or her pre-school experience, provided 

specific information in each of the following areas: 

Knowledge of body parts 
colors 
shapes 
numbers 

Infomation from pictures 
Story comprehension 
Picture comprehension 
Concept knowledge 

Following directions consisting of 
multiple parts 

Copying shapes 

Gross Motor coordination 

Rating of responses during assessment 



etail of the development of the Inventory may be found in the article, 
Boehm, A.E., One Model for Developing a Prekindergarten Assessment Inventory, 
Exceptional Childre n, 1971, 523-527. 
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Where possible, areas of learning were broken down and evaluated at 
different levels. For example, a child might be able to identify and name a 
color (referred to as level 2), identify the color only with the teacher providing 
the color name (level l), or neither of the above. The directions for color 
knov/ledge cor^^-jsponded to these levels. Therefore at 

(Visual l) Level 2 - identify and nam^ - the direction would read, 'VK/VT 

COLOR IS THIS DRESS?" (teacher 
pointing to the red dress, etc.) 

Level 1 - identify c^nly - the direction would read, "SHOW 

ME THE DRESS THAT IS RED" (teacher 
providing the color name), and 

Level N - can do neither - the child is unable to respond to 

either level 2 or 1. 

The Inventory did not attenpt to assess the child's knowledge of the entire spectrum 
of colors, but to sample the level at which he or she appeared to be functioning. 
What resulted from the assessment was: 

(Visusl 2) 1. Teacher enthusiasm about the usefulness of assessment 

2. Systematic observation on the part of the teacher of 
each child's functioning in the areas tapped by the 
Inventory at the beginning of the school year leading 
to more precise classroom planning 

3. Each child serving as his own point of comparison when 
the end of year results were obtained 

U. Some notion was gained of class patterns of general 
strengths and limitations, some of which were develop- 
mental! jased. For example, most pre-school children 
would not be able to copy a triangle at the beginning 
of the school year, and only a few children would be 
able to accomplish this task by the end of the school 
year. 

Before proceding any further, let us cycle back to some basic definitions 
which can provide a general framework for understanding the model employed. A 
basic distinction has been made by Glaser^ between norm referenced and criterion 



^Glaser, R., Instn^ -.tional Technology and the measurement of learning 
O outccHues* American Psychologist , 1963* I8, 519-521. 
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referenced testing* An example of a nonn referenced test is the Peabody Picture 
Vocabulary Test^ which tells us where a child stands in reference to a norming 
population of children who have taken that test. In contrast, on a criterion 
referenced test, attention is paid to how an individual functions on small slices 
of the total tasks, yielding pass-fail infonnacion at each level of behavior 
tapped. The Inventory described earlier would fall into the latter category. 

In the final analysis, norm referenced and criterion referenced tests 
per se are not that different — the difference depends upon their use. In 
using norm referenced procedures we can use the information gained from an item 
analysis; in using criterion referenced procedures we need to consider the 
influence of developmental expectations and sample variables on the test per- 
formance. However, the great advantage with criterion referenced instrments 

is the focus on the individual's functioning with each item type which is help- 

k 

ful for curriculum planning. 

What then might be the necessary considerations for developing new assess- 
ment materials? These include: 

1. Being sufficiently specific about behaviors and 
goals so that it is possible to assess whether or 
not they are present or have been attained, 

2. Being able to task analyze or break down skills 
into their canponent parts so that it is possible 
to develop items yielding pass-fail information 
about each component part, 

3. Making careful analysis of ccanponents and recording 
infomation in a systematic manner, and 

U, Demonstrating an understanding of child development 
and learning. 



^Dunn, L.D., The Peabody Picture Vocabulary Test , Nashville: American 
Guidance Service, 1959^^ ' " 

k 

Tyler and Gagne are other proponents of this approach. The growing 
recognition of the value of criterion referenced assessment has been detailed 
in Perspectives of Curriculum Evaluation , Monograph Series, Rand McNally, 1967, 
No. 2. 
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An important question facing individuals using such procedures is, VIHEN IS OUR 

AMLYSIS SUFFICIENT? 

The answer to this question is far from simple, since most learning areas 

can be analyzed into finer and finer levels of detail. One rule offered here is 

that the analysis must procede from the point vhere minimal competencies are 

tapped for each member of the population for whom the assessment procedure has 

been developed and procede in a stepwise progression until the end criterion 

behaviors have also been assessed. 

An illustration of such a task analysis approach to assessment is the 

5 

Boehm Test of Basic Concept s* In developing this test the goal was to assess 
whether or not kindergarten through grade two children had a functional knowledge 
of basic relational concepts such as "same" and "different" or "in front of" and 
'behind" when these were presented in simple line drawings. Directions required 
only that the child mark the correct option. For example, item 1 (form A) reads: 

(Visual 3) "LOOK AT THE PICTURES OF WRITING iAPER WITH STARS. MRK 

THE mPER WITH THE STAR AT THE TOP. " 
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A survey of curricular materials employed at the primary level was the 
basis of the task analysis and identification of basic relational concepts in 
freqxient use, particularly in directions. Since the purpose of the test was to 
identify which basic concepts presented difficulty for individual pupils, 50 such 
concepts were selected for the final version of the test with additional concept 
terms listed in th-e manual for those desiring to use the test below the kinder- 
garten level or with special populations ♦ 

Although a total score is yielded, the most important information is found 
through inspection of the class profile sheet. Here the teacher or specialist can 
identify individual, strengths and limitations, as well as group patterns, both of 
which can lead to classroom planning. 



^Boehm, A,E., The Boehm Test of Basic Concepts . New York: The Psychological 
Corporation, 1971. 



Since the test is appropriately used in grades k'-2, items have been 
arranged roughly in ascending order of difficulty. Therefore, if a kinder- 
garten child were to miss item 50 (form A), 

"LOOK AT THE GROUPS OF STARS. .MARK THE GROUP THAT 
HAS THE LEAST S'-^^RS" 

v/e might not be as concerned as if a second grade child were to miss the same 
item. 

Where we go in using the res^xlts of the test involves another task 
analysis of skills. This time each concept needs to be task analyzed into its 
many levels of usage from the concrete to the abstract. The test itself provides 
a syxrvey of a large number of concepts; instructional procedures will need to 
tap the many levels of concept learning and application, a problem being worked 
on now in the development of a Resource Guide For Basic Concept Teaching . 

Given our very small knowledge of the processes underlying children's 
functioning and learning, assessment for teaching can only be viewed as an 
ongoing process in constar^t need of re-evaluation. However, the psychologist 
in the schools who has mastered the approach to assessment described, can be 
of increased value to the classroom teacher in planning appropriate learning 
sequences matched to the individual needs of the children involved. 



^Publication of the Resource Guide For Basic Concept Teaching is in 
process , 
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